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QUALITY Of 



EDUCATION OF NATIVE INDIAN STUDENTS IN CANADA 



A 



REVIEW OF RESEARCH 



Arthur J. More 



INTRODUCTION 



The general quality of education of all Canadian school systems 
has come under increasing public scrutiny in the past decade* 
Accusations of declining achievement ie vels among high school 
graduates have been hotly debated in provincial legislatures and local 
school board meetings. The increasing costs of education and 
accusations of declining cost effectiveness have also been a 
significant part of these debates* 

However these debates are not to be confused with current concerns 
for the quality of education of native Indian students. One major 
(1 i f E e re nee between the debates about the quality of school systems in 
i50ncr.1l and the quality of Indian education in particular is that 
academic achievement levels of Indian students are not declining 
hut they continue to be disastrously low. For example, the high 
school completion rate among Indian students has increased In the 
pa-si few years but remains less than one quarter of the national rate 
(Lndian Conditions, 1980); average achievement levels two or more 
years behind grade placement are not uncommon (Thomas, et at., 1 9 7 9 > 
pp.1 6-19). Another significant difference Is that improvement h in thi» 
«i»n*?ral quality of Canadian education may be important, but mnshlvo 
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Improvements in the quality of education of Indian students are 
absolutely essential to the success of the current drive for Indian 
self-determination and self-government (Penner, 1983). 

This paper is a response to the increasing interest and concern by 
Indian people, government agencies and other educators for the quality 
of education of Indian students in Canada. This interest and concern 
has led to a spate of evaluations of schools and programs which enroll 
Indian students. It has also led to a number of studies of the 
process of evaluating the quality of Indian education. There is a 
need to compile and review these evaluations and studies, to identify 
gaps and inconsistencies among them, to assist researchers to develop 
more effective methodology, to assist in program development and to 
improve teacher preparation and in-service. 

PURPOSE 

The purpose of the present study is to review recent evaluations 
and case studies related to the quality of education of native Indian 

students in Canada. 

This paper reviews a very broad range of studies. However it 
concentrates on 15 case studies of actual schools and programs, md 
three general reports on quality of Indian education. The case 
studies were selected on the basis of the availability of written 
reports and the degree to which they represent important aspects of 
evaluation of quality of Indian education. 
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TABLE 1 

Studies reviewed for this paper, showing location, 
investigators, date and type of school 



Location of Study 



Alexandra, Alta (E) 

Alexis, Alta (E) 
Alkali Lake, B.C.(D,I) 
Bella Coola, B.C.(E) 
Chapel Island, N.S.(E) 
Hobbema, Alta (E) 
Klemtu, B.C.(D) 
Lilloet, B.C.(E) 

Manitoba (E) 

Nisgha School 
District (E) 

Northwest Terri- 
tories ( E ) 

Okanagan/Mer rit t , 
B.C. (E , I) 



Tobigue (E) 
Saddle Lake (E) 
Vancouver (E) 



Investigator(s) Date 



Lane 

R & F Consulting 

Johnson 

Dick et al 

Hamilton & Owston 

Alberta Education 

More 

Hebert 

Kirkness 
More et al 

Special Committee 

NWT Legislature 
More 



Hamilton & Owston 
Thomas et al 
Hunter & Stevens 
Joseph 



1982 

1983 
1984 
1983 
1983 
1981 
1983 
J>983 

1978 
1980 

1982 

1984 



1982 
1979 
1980/ 
1981 



Type of Schools 



1 Federal, 3 Provincial, 

2 separate 
1 Federal, 3 Provincial 
1 Band-operated 
1 Band-Operated 

1 Sand-Operated 

2 Federal 

1 Band-Operated 

1 Provincial (Indian 

Language Program) 
8 Federal, 13 Provincial 

3 Provincial (Bicultural/ 
Bilingual Program) 

All NWT Schools 

Provincial, Band- 
Operated and Parochial 
Schools (12 Bands, 
8 School Districts) 

1 Federal 

1 Band-Operated 

i School District 



(D) Descriptive Study 

( E ) Evaluative Study 

(I) Study In-Progress, not completed at this writing 
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The .location, investigators, date and type of school for the 15 
studies are given in Table I. Many of the studies were evaluations of 
.specific schools (Dick et al, 1 983; Hamilton & Owston, 1982 and 1983 ; 
Thomas et al, 1979) or groups of schools (R & F Consulting, 1983; 
Kirkness, 1978; Lane, 1982; More, 1984). Other studies were 
descriptive rather than evaluative (Johnson, 1984; More, 1983). Only 
one of the 15 studies was termed a "quality of education study" by its 
author. However all the case studies relate to evaluation of the 
quality of education and illustrate many of the problems and outcomes 
of carrying out such evaluations. 

The remainder of this paper is divided into four sections: (1) 
Quality of Education - the meaning of the terra; (2) Methodology, which 
discusses the methodologies of quality of education studies; (3) 
Findings, which summarizes the findings; and (4) Discussion. 

QUALITY OF EDUCATION - MEANING OF THE TERM 

I. Lac k of Definition 

The term "quality of education" Is used with Increasing frequency 
by those involved with the education of Indian students. However It 
was actually defined only once In all of the literature reviewed by 
this writer. Of the 15 case studies one specifically defined quality 
o F cducat Ion; six Implied a definition In terms o f provincial 
standards and community goals combined; five l m p I Led a definition 
sul.. .y In terms of provincial standards; one was unclear, although it 
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used a great deal of community Input; and in two studies a definition, 
slated or implied, was not appropriate. Only two studies attempted to 
link quality of education to community goals for education. 

A recent paper prepared for the Department of Indian Affairs and 
Northern Development ( DI AND ) stated that "the quality of First Nations 
Education can be defined in many ways'* (Watson & Goode r ham , 1984, 
P . 11) but failed to provide any of the definitions. The authors 
concluded only that "The 'bottom line* of all this is community 
satisfaction. Are the parents and the students themselves satisfied 
that the school is providing the highest quality instruction that can 
reasonably be expected?" (ibid, p. 11). 

In the' recent discussion paper India n Education Paper - Phise 1,. 
the DlAND chose not to define quality of education. Instead they 
proposed guiding principles which are "... policy boundaries or 
limitations which serve to give meaning to the policy on education" 
(I)IAND, 1 982 p. 16). The proposed guiding principles, as revised most 

recently, are: 

Qua lity of Education 

1. Indian education strengthens the learner s cultural 
Identity. 

2. Indian education helps the students develop what are 
considered the basic learning skills such as language 
and number work. 

3. A basic goal of education for Indians is that each 
student should have the opportunity to achieve to 
the limit of his or her capabilities. 

4. Indian education contributes to the development of the 
community, helping it to meet its social and economic 
goals. It provides skilled workers for jobs i.n the 
community and increases its members' skills so that 
they can increase their chances for employment. 
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5. The quality of Indian education programs is in line 
with Canadian provincial standards, and the department 
is responsible for ensuring this. 

6. The standards used for construction and maintenance 
of Indian schools are based on those used in the 
provinces ( D I AND , 1983). 

The first five of these guiding principles relate to the goals of most 

Indian communities. The final two set provincial standards as 

standards of quality for Indian education. Notwithstanding the 

statement of guiding principles, the "Phase 1 Paper" operationally 

.V" 

defined quality of education, by implication, solely in terms of 
provincial education systems (DIAND, 1982, pp. 17-19, 21, 33, 42). 

Three concerns related to the meaning of quality of education 
arise from these studies: 

(1) lack of definition of the term; 

(2) overuse of provincial standards as indicators of quality, 
regardless of the appropriateness of the standards; 

(3) lack of relationship between community goals and quality 
of educa t Ion . 

2 . D efinition of Quality of Education 

In this paper the definition used by the author In the 
Okanagan/Nicola Quality of Education Study (More, 1984), is employed. 

Quality of education Is the degree of relationship between: 

(a) the educational goals and objectives of the Indian communities 
and 

(b) student achievement In Its broadest sense (More, 1984, p.l). 
The degree of relationship, or "goodness of fit", between goals 

and achievement Is the essential. Ingredient. This definition is 
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designed to overcome the three concerns listed above. It particularly 

provides for a direct link between quality of education and community 

goals for education. Figure 1 presents a model for evaluating quality 

of education based on this definition. 

The clearest statement of the educational goals of Canadian Indian 

people is contained In the National Indian Brotherhood policy pap 4 er 

Indian Control of Indian Education: 

Our aim is to make education relevant to the philosophy 
and needs of the Indian people. We want education to 
give our children a strong sense of identity, with 
confidence in their personal worth and ability. We 
believe in education: 

- as a preparation for total living, 

- as a means of free choice of where to live and work, 

- as a means of enabling us to participate fully in 
our own social, economic, political and educational 
advancement (1973, p. 3). 

This statement of lucational goals provides the standard for 

determining quality of education in this paper. This standard is only 

appropriate to an individual Indian community if the goal statement 

la appropriate. To be most useful a series of specific local or 

regional educational objectives would have to be developed from this 

goal statement by a group of Indian parents and educators. 

METHODOLOGY 

I . Reasons f o r the Studies 

' The underlying reasons for carrying out most of Liiu 
cnse studies reviewed for this paper were serious concerns for lack of 
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Figure 1. Model for evaluating quality of education 
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Indian Communities 1 : 

1. Specified in a measurable 
form wherever possible 

2. Separated into product and 
process objectives to parallel 
achievement (product) and 
process variables. 
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1, Community Perceptions of the 




1. Community 




education process 




a. Cultural 




2. Governance (local, etc.) 




b. Economic 




3. Instruction 




c. Social 




a. Teaching Processes 




d. Geographic 




b. Teacher Skills 




2. Mobility 




c. Teacher Preparation 




3. Self-Esteem 




4. Curriculum including Native 




4. Learning 




Indian Content 
S. Administration 




5. Hearing 






6. Vision 




6. Facilities 




7. Perceptual- 




7. Teacher perceptions of the 




Motor Skills 
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education process 
8. Support Factors 

a. Special Education 

b. Community Programs 

• • 
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Achievement in its Bi .- oadeSt Sense 
{Product Variables) 

1. Community perception of the 
products of education 

2. Standardized Achievement Tests 

3. Teacher Tests 

4. Drop-outs, Graduates 

5. Age/Grade Deceleration 

6. Attendance 

7. Type of Program Placement 

8. Teacher Perceptions of the 
Products of Education 

9. Grades. 

10. Self-Esteem 

11. Student Perceptions of the 
Product of Education 

12. Employment Rate and Type 




QUALITY OF EDUCATION 
IS THE DEGREE OF 
RELATIONSHIP BETWEEN* 

(a) THE EDUCATIONAL 
GOALS AND OBJECTIVES 
OF THE INDIAN COMMUNITIES 

AND 

(b) STUDENT ACHIEVEMENT 
IN ITS BROADEST SENSE. 



J 



^Communities refer to geographic coirwuni^ics such as Reserves , 
or the Indian people making up Indian communities in towns and cities 



co o 



MIKRC 
9 



success of students. In some cases there was a specific problem 
(Hamilton & Owston, 1982; Thomas et al, 1979). In other cases the 
concern was more general (Hunter and Stevens, 1980; Alberta Education, 
1981). In six of the 15 studies a new program had completed a year or 
more of operation and a formative evaluation was appropriate (e.g. 
Dick et al, 1983; Hebert, 1983; More et al , 1980). In three cases the 
question of Band takeover of the schools was one of the questions to 
be answered by the study (Lane, 1982; R & F Consulting, 1983; Hamilton 
& Owston, 1982). In one case the study was to develop and test a 
design for an evaluation framework (Kirkness, 1978, p. 53) as well as 
evaluate the education of a group of Indian students. 

None of the studies involved a school or program which had- been 
considered successful over a long period of time. Such studies would 
have been a valuable addition to this analysis. Indeed any 
province-wide or nation-wide study must include them. However it is 
this writer's experience that, although long-term successful 
situations exist, they are seldom evaluated. 

2 . T ype of School 

The studies involved the full range of schools attended by Indiana 
students: Band-operated, Federal, Provincial, Territorial and 
Parochial. Ml the studies, except one, had the Indian students as 
the main focus and Non-Indians were included only for comparative 
purposes. The exception was the Northwest Territories study which 
Eocussed on the total educational system - although Indian and Inult 
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student concerns were a very significant part of it (Special Committee 
on Education, Northwest Territories Legislative Assembly, 1982) • 

Of the fifteen studies, five dealt with Band-operated schools 
only; two dealt with federal schools only; three dealt with provincial 
schools only (although one provincial system - Nisgha - is 
Band-controlled); four dealt with a combination of school types; and 
one dealt with Territorial schools only. 
3 . General Design 

The general design of the studies usually involved four steps: (1) 
consultation with community in designing the study; (2) collection of 
data on a series of process variables (e.g. curriculum, instruction, 
learning styles) and product variables (e.g. t^st results, drop-out 
numbers); (3) subjective evaluation of results; and (4) development of 
recommendations. 

Community involvement in steps I and 2 was usually significant. 
The community involvement was channeled through the local Educational 
Authority, the Band or a Steering Committee. However community 
involvement in steps 3 and 4 was usually minimal, consisting most 
frequently of responding to a draft report written by the 
investigators. The opportunity for in-depth community involvement Ln 
the final two steps was overlooked in most cases. 

The evaluation of results and the development of recommendations 
was seldom done in a clearly defined manner or according r. o a 
predetermined model. In particular, the standards against which the 
results were compared were only vaguely described, L f at all. 

ERIC 
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Provincial standards were often referred to but seldom used with any 
specificity. In most cases the investigators relied on their varied 
professional experiences to carry out this task. 

The result Ls that in most studies the reader is usually left with 
the questions "What did this study mean by quality? What were the 
standards?" In addition the reader is often left with a vague notion 
chat if only Federal and Band-operated schools followed Provincial 
standards, quality would be achieved. But evaluators usually dash 
this notion with their concerns about cultural irrelevance in 
provincial curricula, instruction and testing. 

One way of dealing with this situation as illustrated in Figure 1, 
is for the investigator to work with the community to establish a set 
of educational goals of the Indian community. From these goals, 
a set of specific educational objectives, is generated. it is against 
these educational objecives that the data and results are compared by 
tha investigator and community representatives. The Acwsakta School 
at Bella Coola has developed such a set of goals and objectives (Dick 
.it a I, 1983, pp. 5-7). Recommendations for changes in the education 
process are the*- developed from this comparison of process variables 
iiia product variables with educational goals and objectives. 

One problem of this approach is the difficulty and time involved 
in developing goals and objectives. The usual door-to-dour survey 
is insufficient. A series of time-consuming discussions, meetings and 
wor's .{hops with all concerned parties would be necessary. However it' 
th«» standards of comparison for determining quality of edur.it inn ar*> 
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t " be clear, and if these standards are to come from the Indian 
community, the additional effort is necessary, This writer is 
currently involved in a quality of education study in which 12 Bands 
are wrestling with the difficulties of developing their first 
statements of educational goals and objectives and is well aware of 
the difficulties, as well as the potential benefits, of this approach 
(More , 1 984) . 
4 • Variables 

The studies have used a large number of variables, although there 
is a set common to most of the studies. The variables may be group ad 
into three types: 

(1) product variables, which are concerned with the products of 
education, such as marks, test results and drop-out rates; 

(2) process variables which are concerned with the educational 
process such as instruction, curriculum and facilities, and 

(3) background variables which are concerned with factors which 
►* k i h t prior to or separate from the educational system, such as 
Learning style, socio-economic conditions, cultural variables. 

If the "process" of education is effective, particularly if it is 
appropriate to the "background" variables, then the "product" should 
be of high quality* 

This grouping of variabLes is an essential, ingredient in tho model 
4 >roposod by this paper. Table 2 lists most of the variables and their 
frequencies as used in the fifteen case .studies reviewed for this 
p a p o r . 
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TABLE 2 

Variables and their frequencies of use in the 

reviewed for this pa per 



Product Variables 

' i . Community perceptions (of the product) 

2. Standardized achievement, tests 

a. Reading 

b. Math 

3. Drop-outs 

4 . Age-gr-ide deceleration 

5 • Attendance 

6 . Type of prog ram placement 

7. Teacher perceptions (of the product) 

8. Graduates 

9. Marks 

10. Se Lf -es teeem 

11. Student perceptions (of the product) 
Process Variables 

K Community perceptions (of the process) 
2. Instruction 

3 . Curriculum 

4 Cultural content 

a. Indian language 

b. Indian culture 

5 . Ad mi nis t rat ion 

6 • Facilities 

7. Teacher perceptions (of the process) 

8. Support factors 

. Spec: la I Hu .a t i on 
h . C o u n s e I L i n g 
( ) . Enro Lme n t 
ID. At te ndance 

11. Student perceptions (of the process) 
I !> . Motivation 

13. Non-Indian community percept Ions 

14. Teacher qualifications 

R _ a £* 8 r °H. nci y_aj^iables 
I . Cum m u nit y factors 
a . Cult tt ra 1 
b . E c o n o mic 
c . Social 





d . G e o r a p h f. c 


2 . 


f.p/) r n i n# S t y 1 e .s 


3 . 


Mobility of students 


4 . 


Self-eat o u m 


5. 


Fl e a r i n g 


fj . 


Vision 


7 . 


P t > r c. p p t u a 1 - m o t o r skills 


i * 


f n t * 1 1 1 i ? '*> n o t 1 t o s t s 



* /rJqiurncy "iX'greaVe r "than the number of sf: 
bi* ratt.su some studies used morn than one 
standardized raodasure of reading. 



15 

17* 
7 

10 
8 
7 
5 
5 
3 
3 
3 
2 

13 
13 
1 I 

6 

8 
ft 

7 
7 

6 



4 
'♦ 
4 
4 



Var tables 



Frequency 
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4.1 Product Variables. 

Community perceptions may relate to the products of education or 
to the processes of education. Community perceptions as a product 
variable appeared in every case study. 

Other frequently used product variables were standardized 
achievement tests (particularly CTBS), reading (particularly 
Gates-McGinitie) , drop-outs, age/grade deceleration and attendance. 

The use of standardized achievement test measures was often 
qualified by concerns about the cultural relevance of the content and 
the bias inherent in the norms. In some cases development of Indian 
norms was recommended (e.g. R & Y Consulting, pp. 30-31). This writer 
supports the concerns about the cultural relevance of such 
standardized achievement tests as the Canadian Test of Basic Skills. 
This is particularly important for Band-Operated schools in which the 
goals and curriculum may vary considerably from those schools on which 
the test content was based. However it is also possible that the 
usefulness of such tests may be downplayed too much in situations 
in which the Indian parent's educational goals and the curriculum they 
prefer are virtually the same as those of the non-Indian community. 
This writer also questions support for the concept of national or 
provincial Indian norms for such tests when there are such great 
differences between Indian communities and between curricula of 
Band-operated schools. In order for a standardized test to be 
accurate for Indian students it nust be relevant to the Instructional 
goals of a particular school or group of schools. And the norms 
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must be based on the sa...e school or schools. 

In some studies the drop-out rate included only students who left 
during the school year, September to June (e.gv Kirkness, 1978, p. 70). 
Since many, possibly most, drop-outs occur during the summer months 
the in-school drop-out rate has little value. 

Self-esteem was included as a product variable in three studies, 
but in only one was it measured precisely (Hebert, 1983, p. 10). 
Hebert's study showed a possible positive relationship between 
enrolment in an Indian language course, self-esteem and achievement. 
4.2 Process Variables. 

The process variables used most frequently were community 
perceptions of the education process, instruction (although usually 
not measured precisely) and curriculum. 

There were frequent references in most studies tc the problem of 
cultural relevance of the curriculum. However it was only a specific 
variable in six studies and then only generally observed. None of the 
studies distinguished between relevance to contemporary Indian 
cultures as discussed by La Roque (1975) and relevance to traditional 
Indian cultures. One is usually left with the impression that the 
reference is only to traditional Indian cultures. 

Most of the recommendations from the case studies are for changes 
in the education process, that is they relate to the process 
variables. However careful analysis of the links between process 
variables/product variables/educational goals, was not a part of the 
development of recommendations. One method of overcoming this problem 

18 
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could be based on the relationship Illustrated in Figure It 
4.3 Background Variables. 

Background variables are used least frequently, possibly because 
they are perceived to interact only indirectly with the quality of 
education. However evaluation of educational quality must include an 
assessment of the degree to which the education process is being 
adapted to the background variables* 

learning style is a backg round variable which is often overlooked* 
largely because of a dearth of research with Indian students. Only 
two studies actually used learning style instruments to investigate 
this type of variable. 

The Okanagan/Nicola study is showing some potentially 
exciting learning styles results, particularly related to beginning 
reading (More, 1984). However results are not complete at this 
writing. 

Background variables related to hearing and vision though seldom 
used, have useful potential. At Alexander Reserve, 22 of 48 children 
werci found to have some degree of hearing impairment (Lane, 1982, 
pp . 4 5-4 6 ) . 

5 • Other Qua llt^y of Educ ation Methodology Studies. 

Three recent papers have studied the methodology of quality of 
education studies and re commme nded changes In the educationa process 
for Tndlan students (Watson, 19 8 3, VoK3; Watson & Gooderham, 1984; 
Assembly of Manitoba Chiefs, 1984). 

One paper deals solely with quality of Instruction and "...does 
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not attempt to answer the question 'What is a quality education?*" 
(Watson, 1983, Vol.3, p.l). Tt provides a useful discussion of common 
methods of evaluating student achievement. This is followed by a 
report on existing practices in evaluating quality of instruction, 
based on a questionnaire nent to all Indian schools in Canada (ibid, 
pp. 19-53). The study found that about three-quarters of Indian schools 
use standardized achievement tests, 53% used the CTBS and 21% used the 
Gates-McGinltie Reading (ibid, pp. 21-24). The study also found that 
reading, writing and attendance problems seriously affect the accuracy 
of attempts to measure student achievement (Ibid, pp. 40-41). 

The Watson and Gooderham report includes a discussion of standards 
of quality of education (1984, pp. 10-14). They point out that those 
who favour the use of standards agree that they are required for 
effective planning, implementation, accountabilty , and for determining 
whether a student has attained at least the minimum level required to 
move on to a higher level skill. Those who oppose uniform standards 
argue that they deny individual differences and that they are usually 
Inappropriate, due In part to differences In language and culture 
(ibid, p. 10). The report adds that, In practice, standards for Indian 
schools usually bring together "norms" of many kinds including 
community standards and expectations, school standards, teacher 
experience, developmental norms and test norms (ibid, p. II). 

The report also refers to a high level of concern among teachers 
that the standards of standardized achievement tests are not 
appropriate to Indian pupils. This writer is concerned about the 
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misconception that standardized achievement ".ests set standards. The 
norms of standardized achievement tests permit a comparison with the 
"average" non-Indian Canadian of a particular grade level, but they do 
not set standards. There Is a misconception tnat the grade placement 
score used by CTBS and other standardized tests Is a standard rather 
than simply an average score for a specific group of students. This 
misconception might be reduced by use of raw scores, or even 
percentiles (ibid, pp. 11-14). 

Most standardized test scores have little diagnostic value because 
any one score, even on a sub-test, covers a wide range of skills. 
Standardized tests which provide a detailed breakdown of results, 
accompanied by specific remedial and developmental aids, are far more 
useful than the general standardized tests in use. Such detailed 
tests, for example the Metropolitan Reading Instructional Battery, 
allow the teacher to concentrate on those specific skills which relate 
to the objectives and curriculum of the particular school and provide 

teaching aids to assist. 

Watson and Gooderham also provide an extensive analysis of 
curriculum practices and Issues including curriculum modifications, 
role of tilt; Indian community, Native language instruction and Hucond 
language instruction (ibid, pp. 15-30). They also summarize Federal 
and provincial data on teacher qualifications, recruit.nent and 
s u p p o r t » 

The report of t h o A s s e m b I y of Ma n i t o b a Chiefs is p r I m a r i I / a 
detailed proposal for significant restrur.turi.ng of Indian education in 
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Manitoba to achieve quality education while retaining local control 
and flexibility. The report also summarizes findings of other studies 
of product and process variables related to Indian education in 
Manitoba. The report is highly significant In that it proposes a 
basis for providing quality education by different processes 
appropriate to the needs and desires of individual Indian communities 
(Assembly of Manitoba Chiefs, 19 84). 

FINDINGS 

Most of the case studies reported the result on a series of 
product and process variables. These results were then subjectively 
evaluated by the investigator and recommendations were developed. 

For the present paper we return to the operational definition of 
quality of education which emphasizes the relationship between 
educational goals and student achievement. It is difficult to analyze 
the relationship in this paper because a detailed statement of 
educational goals and objectives of Canadian Indians is not available, 
there is, however, an excellent general goals statement statement 
from Ind I a_n __C o nj_r o 1_ of Indi an Educat ion (National Indian Brotherhood, 
1973, p. 3) quoted earlier In the present paper. It is possible to 
develop detailed statements which are consistent with the N* T B paper 
and other findings from community surveys as proposed in the mod"] in 
Figure 2. Such a step is necessary to provide a detailed analysis oi 
quality of <? d u cat! o a . Rv e n more important, reoorara e n d a r. i n n >: for 
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improving the process of education would benefit greatly from a 
detailed analysis of educational objectives and product variables. 

I . Products 

The most direct way of evaluating the quality of education is in 
terras of the products of the education systems. 

1.1 Identity and self-worth 

The NIB statement referred to a strong sense of Identity and 
self-worth. The findings on this topic are unclear. Parent and 
student perceptions indicate this goal has not been achieved although 
there are no direct measurements, of it. 

1.2 Completion of high school 

All studies show a strong desire stated by parents for their 
students to complete high school. This goal is also consistent with 
the NIB statements concerning preparation for total living and 
providing a free choice of where to live and work. 

The extremely high drop-out rate reported in most case studies 
indicates a poor relationship between parent goals and student 
achievement, that is , an extremely low quality of education for Indian 
students. It is often argued by some educators that conditions outside 
of the education system, such as lack of parent support and economic 
factors, contribute to the huge drop-out rate. Information on 
background and process variables reported in the studies support 
this argument to a degree. However a drop-out rate for Indians four 
times higher than the national non-Indian rate can hardly bo 
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attributed completely to factors outside of the educational system. 

1.3 School achievement 

Every single measure of student achievement in every study 
reviewed for this paper showed Indian students to be behind their 
non-Indian counterparts. At the same time most parents and Indian 
organizations have equivalent achievement as one of their major goals. 
There still are problems of cross-cultural measurement involved in 
assessing achievement of Indian students. However it is reasonable to 
conclude that Indian students, on the average, are achieving far 
below the level their parents and the educational systems desire. 

In terms of school achievement, the quality of education of Indian 
students is very low indeed. 

1.4 Indian self-determination 

Indian self-determination is a major thrust of Indian people 
across Canada. The NIB statement reflects this in its goal of 
enabling Indian people to participate fully in their own social, 
economic, political and educational advancement. 

None of the studies measured this directly. However the drop-out 
rates, age/grade deceleration and achievement findings indicate that 
this goal is not being achieved. Again, a poor relationship between 
educational objective indicates a low quality of education. 



2. Processes 



It is possible also to evaluate the quality of education in terms 
of processes* 
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2.1 Indian philosophy and cult ural relevance 

The NIB statement referred to. the relevance of the curriculum to 
Indian philosophies and cultures. Many of the studies reported the 
desire of Indian people for more culturally relevant curricula* Many 
of the Band -ope rate d s c h 09 Is were i ns t i t u ted precisely for t h i s 
purpose* 

The quality of education in terms of relevance to Indian 
philosophies and culture appears to be generally low with some notable 
exceptions in some of the Band-operated schools* 

2.2 Quality of curriculum and instruction 

The Indian communities in the case studies desire high quality 
curricula and instruction* This was often stated by comparison to the 
provincial school systems. However few studies attempted to assess 
this other than take a cursory look at cultural relevance. Some 
investigators met resistance to the evaluation of instruction. The 
Watson-Gooderham report (1984) and the Assembly of Manitoba Chiefs 
(1984) report a variety of findings indicating that the quality and 
appropriateness of curriculum and instruction are seriously lacking in 
federal and Band-operated schools, in relation to provincial standards 
and, presumably, Indian parents' goals. 

2. 3 Facilities 

The Indian communities in the studies desired good quality 
educational facilities. As with curriculum and Instruction t h i « 
desire was stated in terms of provincial school systems. It can be 
demonstrated from the studies which evaluated facilities that the best 
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facilities are usually in the provincial systems. A mixture of 
excellent and very poor facilities were reported in federal and 
B a n d - o p e r a t e d systems. In fact some of the buildings for 
Band-operated schools were ideal for the needs of the school, but were 
inadequate or inappropriate by provincial standards. 
2.4 Teacher preparation and in-service 

A minority of studies reported on teacher preparation and 
in-service (e.g. DI AND , 1982; Watson & Gooderham, 1984). However in 
each case, concern was expressed for tlie lack of preparation and 
in-service for teachers in terms of understanding the background and 
culture of the Indian students, learning to adapt appropriately to the 
educational background and needs of the Indian students, and having 
the time and skills to adapt existing curriculum materials. 



3 . Effect of Quality of Education Studies 

A number of the investigators have reported that the pro ce s s 
of carrying out the study has raised the awareness of education in the 
community and has been an important educational experience for many 
community members (Kirkness, 1978; Thomas et al., 1979). Those studies 
which involved a larger proportion of the community report this result 
more frequently. The successful community involvement seems to go 
beyond the educational and political leaders to the M grass roots 11 
members of the community. It is unfortunate that this result is not 
reported in more detail, so that other studies can take advantage? of 
it . 
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DISCUSSION 



It is possible, but probably not effective, to review many other 
aspects of the quality of education of Indian students. It is more 
appropriate at this point to provide a number of concluding statements 
to draw together the wide-ranging topics of this paper. 

1 • Quality of Education . 

There is no question that the quality of education of Indian 
students in Canada is very low by virtually any measure. 

However the sources of the difficulties are still not understood 
in any detail. For example the degree to which lack of support 
services in small, isolated schools, and the degree to which economic 
factors contibute to these difficulties is not clear. 

Even more important, the resources available to ameliorate these 
difficulties are not clearly understood. For example, local control 
Is extremely important to overcoming problems of education quality for 
Indian students. But the manner in which local control can work most 
effectively has not been carefully investigated. An exception is the 
recent Manitoba report which contains one of the most useful 
descriptions of effective use of local control (Assembly of Manitoba 
Chiefs , 1984) . 

2 . Conce rns • 



Five concerns arise from this review: 



2.1 The case studies and other papers reviewed for this paper 
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frequently show an overdependence on provincial standards for Federal 
and Band-operated schools. It is important that standards be derived 
from the long-term goals of the Indian community rather than from a 
simplistic transfer of goals from the non-Indian school system. 
Indeed Kirkness found no appreciable difference in achievement between 
students enrolled in provincial and federal schools (Kirkness, 1978). 

2.2 The quality of many of the case studies varied 
considerably. Some were carefully executed, precisely analyzed and 
clearly written. Others were little more than the opini.ons of the 
investigator with a few, occasionally unrelated tables and factual 
statements added. It is important that the DIAND, educational 
institutions, and Indian organizations accept only the highest quality 
workmanship in these studies. 

2.3 None of the studies to date have distinguished between 
education and schooling. Education provided in the home and the 
community is a very important component in addition to schooling. It 
is strongly recommended that this concern be included in any further 
studies of the quality of education of Indian students. 

2. A Recommendations are very subjectively determined. There is 
seldom a structured process for developing recommendations. The 
recommendations are usually based on the experience (or biases) of the 
investigator. There is seldom a consideration of the links between 
product variables, process variables, background variables, and 
educational goals and objectives of the Indian community. 

2.5 Community surveys do not tap educational goals and 
objectives tn sufficient depth. Most community surveys require very 
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brief responses and are usually conducted by mail or by using a 
door-to-door Interviewer. This procedure provides some useful 
information on community perceptions of the products and the processes 
of education. But it seldom provides more than superficial 
Information concerning educational goals and objectives of the Indian 
community. A series of Interviews, discussions and workshops with a 
broad range of the Indian community is required. This is not easy to 
accomplish, as this writer can testify from his work in Klemtu and 
Okanagan/Ni cola (More, 1983 and 1984). We have been developing a 
process which includes interview/discussions with small groups of 
people conducted by trained interviewers from the community. This is 
followed by meetings and workshops to finalize the statements of goals 
and objectives. We are not satisfied that we are doing this 
effectively enough yet. The process needs more refining. Kirkness' 
study ( 1 978 ) used a series of flexibly structured workshops in each 
community at the beginning and the end of her study. As a result she 
was able to develop a deeper community input into statements of goals, 
and development of re comme nda t io ns • Certainly the benefits in terms 
of more clearly stated goals and objectives which can be compared to 
results, outweigh the additional effort required. 



3 • Definition and model for evaluation o f quality of education. 

There is clearly a need for a definition of quality of education 
of Indian students. An evaluation model that builds upon that 
definition, which Incorporates community goals, and which provides a 
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more structured process for developing recommendations, is essential. 
A definition and an evaluation model to fill these needs are proposed 
in Figure 1. 

4. Teacher Preparation and In-Service. 

Teacher preparation and in-service is an area in which 
significant concerns are expressed and recommendations made. An 
increasing number of teachers have taken cross-cultural courses in 
their preparation. A limited number of schools provide a structured 
orientation to the Indian community. However results indicate that a 
great deal more needs to be done, particularly at the local level. 
Teachers need the background information and the skills to adapt 
effectively to the educational needs and background of their Indian 
students. 
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